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ABSTRACT 


This study consists of a factor analysis of the behav- 
ioral dimensions oe the current Marine Corps Performance 
Evaluation System, using randomly selected fitness reports 
for officers in the grades Second Lieutenant through Colonel. 
The objectives and uses of performance evaluation, both in 
the Marine Corps and in general, are discussed and the factor 
analysis methodology is developed. The fitness report data 
is then analyzed, leading to an identification of three 
underlying factors common to all behavioral dimensions. The 
nature and composition of these factors is then discussed. 
Finally, it is concluded that the Marine Corps Fitness 
Report could be effectively simplified by using the three 
common factors rather than the 22 dimensions in current 


use. 
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i. VINTRODUCTION 


The purpose of this thesis is to conduct an analytic 
study of the Marine Corps' Performance Evaluation System to 
determine whether or not the system, as currently implemented, 
measures clearly, concisely, and unambiguously that which it 
is designed to measure. The study employs a statistical 
technique called factor analysis and relies on data supplied 
by Headquarters, United States Marine Corps (Code MMPA), 
Washington, D. C. 

Performance evaluation in general, and the Marine Corps 
system in particular, are discussed. The factor analysis 
technique is developed, not rigorously, but in sufficient 
detail to allow readers to understand the meaning and sig- 
nificance of the results. 

The data is then analyzed, showing the statistical 
correlations between the dimensions of the evaluation, lead- 
ing to a demonstration of how the system could be streamlined 
by utilizing the few underlying factors rather than the many 


Gimensions. 


II. PERFORMANCE EVALUATION 


A. GENERAL 


The success or failure of any organization, large or 
small, \complexsor simple, military or civilian, as*tied 
directly and inextricably to the performance of its personnel. 
mhrs is nokttovsayrthat other factors do not exist; or’ even 
that they are insignificant, but ultimately it is people-- 
human beings--who make the organization succeed or fail. It 
is people who run the machines, program the computers, and 
make the important decisions. And it is people who determine 
the objectives of the organization, set its standards of per- 
formance and evaluate its personnel on the basis of those 
standards. 

The key to this important determinant of organizational 
output is an effective and efficient personnel performance 
evaluation system. It is such a system which will, in the 
long run, determine the "quality" of the organizational actors 
and thus of the organization, for it determines who will rise 
to positions of leadership and authority, and who will be de- 
moted--or even fired. "Quality" is used here in a relative 
sense, meaning "degree of excellence when compared to the or- 
ganizational standards." More specifically, the system 
(ideally) measures the actual and potential contributions 


of the individual to the success of the organization. 


enti tobe rE 


All organizations use some type of performance evaluation 
system. People are always judging the performance of others-- 
peers, subordinates, superiors. The system may be either for- 
mal or informal and its essential elements will vary widely, 
depending on the objectives, size, complexity and general 
structure of the organization itself. Each organization in- 
ternally defines its own objectives, its own standards, and 
must, therefore, determine its own evaluation technique. By 
far the most common rating technique and the one used by the 
Marine Corps is the subjective rating scale in which several 
dimensions of an individual's performance are measured against 
a standard (below average, average, above average, etc.). 
themadvantages: of this technique. are that it is clear and easy 
to use, but it is also subject to rater biases, leniency, 
central tendency, and the halo effect (having the rating on 
one dimension affect all others either positively or nega- 
tively). 

Regardless of the technique used, however, the objectives 
of the performance evaluation system are generally the same. 
According to E. F. Huse (5), these objectives are: 

1. Meeting organizational objectives and improving per- 
formance--the subordinate needs to aon what his objectives 
are and to obtain feedback about his performance and areas 
for improvement; 

2. Proper salary administration--the manager needs to 
neview the! performance of his subordinates in order to recom- 


mend proper salary action; 
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32 ‘Collecting and storing data for future administrative 
actions on promotions, transfers, and demotions or discharges; 

4. Identifying training needs--the organization needs to 
maintain accurate, current information about the strengths 
and weaknesses of its employees in order to develop timely 
and appropriate training programs; 

5. Improving the selection of new employees--if an organi- 
zation is to have a systematized, valid selection system, it 
needs proper criteria against which to validate its selection 
instruments. 

A different technique or appraisal approach may be required 
for each of these objectives, but more often than not, organi- 
zations attempt to use an all-purpose form such as the sub- 
jective rating scale mentioned above to simultaneously satisfy 
pmieotithena | eThistis’not toSimply a criticism of either the 
all-purpose approach or the organization opting to use it. 

The all-purpose form may satisfy the objectives of the organi- 
zation to such an extent that the additional complexity of 
Miuteaple—-fOrms "iS not Justified; or it may “simply be “an 


economic necessity. 


B. PERFORMANCE EVALUATION IN THE MARINE CORPS 


The objective of the Marine Corps performance evaluation 
system, as stated by Marine Corps Orders of the 1610.7-series 
is to provide, for all officers and noncommissioned officers, 

a fitness report which is an evaluation of duties performed and 


the manner in which performed. Such reports represent a com- 
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prehensive portrayal of the professional qualifications, 
personal traits and characteristics, and potential of the 
individual. The order further states that fitness reports are 
bhesprincipal record of a Marine's performance and conduct and 
as such are vital in determining duty assignments and in sel- 
ection for promotion. The system, as thus described by the 
order, embraces three of Huse's five objectives, omitting the 
objectives of providing records for training and selection of 
new employees. The requirements for such records obviously 
exists within the Marine Corps, but they are satisfied by 
other means. The principal instrument of the Marine Corps 
system is a single, all-purpose subjective rating form, an 
example of which is contained in Appendix A. The form pro- 
vides for the measurement of 21 dimensions of performance on 
a rating scale from unsatisfactory to outstanding. There is 
also a provision for a rating of "Not Observed" in case a 
particular performance dimension is not demonstrated during 
the period of the report. 

The Marine Corps Order defines 14 of the 21 performance 
dimensions. They are: 

1. Endurance: Physical and mental ability to carry on 
under fatiguing conditions. 

2. Personal Appearance: The trait of habitually appear- 
ing neat, smart, and well-groomed in uniform or in civilian 
attire. 

3. Military Presence: The quality of maintaining appro- 


priate dignity and soldierly bearing. 
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436 AEtLeneTone too Duky : Industry, the) trait. of working 
thoroughly and conscientiously. 

5. Cooperation: The faculty of working in harmony with 
erhers, bothi military and civilian. 

6. Initiative: The trait of taking necessary or appro- 
priate action on own responsibility. 

7. Judgment: The ability to think clearly and arrive 
ae Logical conclusions. 

8. Presence of Mind: The ability to think and act promptly 
and effectively in an unexpected emergency or under great 
Strain. 

wo Foree: “The faculty of carrying out with energy. and 
resolution that which is believed to be reasonable, right 
ervduty. 

LOVSetLeadenship: “Theheapacity -to-direct,. control, and 
influence others and still maintain high morale. 

hiGowioyaltysr The qualityto£f rendering faithful and willing 
service, and unswerving allegiance under any and all circum- 
Stances. 

12. Personal Relations: Faculty for establishing and main- 
taaning’ cordial relations with both military and civilian 
associates. 

13. Economy in Management: Effective utilization of men, 
money, and materials. 

14. Growth potential: The capacity for professional devel- 


opment. 


The remaining 7 of the 21 dimensions are undefined and left 
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Eo the Imteerpretatwon of, the matenesatimplicit an this omission 
is the assumption that they are self-explanatory, an assump- 
tion which may or may not be justified. These undefined 


dimensions are: 


1. Regular duties 

2. Additional duties 

3. Administrative duties 

4. Handling officers 

5. Handling Enlisted Personnel 
6. Training Personnel 


i. tactacal” Handling Of Troops 


The report provides for the appraisal of a final dimen- 
sion, entitled "General Value to the Service". This item is 
the last evaluation on the fitness report and there is a temp- 
tation, consciously or otherwise, for the raters to treat it 
as a composite or average of the previous 21 marks. The 
Marine Corps Order, however, clearly and specifically advises 
against this, stating that it should be an estimate of how the 
Marine compares with all other Marines of the same grade (rank) 
known to the rater, taking into consideration all important 
factors. It is thus intended to be a separate and unique 
mark, not a composite. 

All dimensions except the last (General Value to the 
Service) are rated on a six-point scale from unsatisfactory 
to outstanding. The scale values, with definitions from the 


order, are as follows: 
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ey Outstanding: “one of the clearly superior individuals 
Of his grade known to the reporting officer (rater). 

2. Excellent: qualified to a degree seldom achieved by 
others of his grade. 

3. Above Average: highly qualified. 

4. Average: qualified to a generally accepted standard. 

5. Below Average: below the generally accepted standard. 


6. Unsatisfactory: unacceptable performance. 


The final Gimension is rated on a ten=point scale, using 
the six scale values defined above plus intermediate values 
among the top five, i.e., between below average and average, 
between average and above average, etc.. 

A careful examination of the definitions of the dimen- 
Sions of the Marine Corps fitness report reveals a potential 
for overlap or confusion among them. For example, the defini- 
tion of initiative implies a certain amount of judgment, since 
fimspecit1es “appropriate action". Similarly, it is difficult 
to imagine good personal relations in the absence of a positive 
Spirit of cooperation. To the developers of the form, each 
dimension undoubtedly applies to a separate and distinct aspect 
of performance, but what about to the users? Are they able 
to make the subtle distinctions or are they, in fact, evaluating 
a smaller number of dimensions by basing their evaluations of 
several dimensions on a single characteristic as they see or 
are mentally able to define it. If overlap actually does exist, 
the question arises as to whether or not the number of dimen- 


sions could be reduced to the point where users are able to 


14 


Clearly distinguish among them. Simplicity is certainly a 
worthy objective of any rating system, and if the form could 
be simplified to a smaller number of dimensions which the 
users see as distinct and unambiguous, while still providing 
an adequate evaluation of the relevant dimensions of perfor- 
mance, then such a step would necessarily be an improvement. 
To test the hypothesis that simplification is possible, 
that the essential characteristics of individual performance 
could, in fact, be evaluated by using a smaller number of 
dimensions, a large body of summary fitness report data was 


subjected to an analytic technique called factor analysis. 
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LILI. FACTOR ANALYSIS 


This chapter presents background information concerning 
factor analysis and discusses the methodology used in this 
study. Factor analysis is a statistical technique formulated 
by psychologists at the turn of this century to provide 
mathematical models for the development of psychological 
theories of human ability and behavior. Because of its 
Origin and extensive use in psychology, it is often regarded 
as psychological theory, but it has been adapted for use in 
NGENGE areas where numerous interacting measurements are, ob- 
tained. Its use has greatly expanded as a consequence of 
the development of high-speed electronic computers. 

Since the objective of this study is to subject a set 
of Marine Corps fitness report data to factor analysis, 
rather than to either develop or illustrate factor analysis 
itself, the technique will not be described in great detail. 
What will be presented is just enough for the reader to be 
able to follow and understand the origin and nature of the 
answers and conclusions which result. For a more thorough 
discussion of the technique, the reader is directed to any 
of the references listed in the bibliography, especially the 
one by H. H. Harmon. 

It should also be noted at this point that a Biomedical 
(BIMED) computer program (BMD08M) was used in this analysis, 


so the computational details are not required to either 
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achieve or understand the results. A general understanding 


of the technique is, however, essential. 


A. OBJECTIVES OF FACTOR ANALYSIS 


The primary objective of factor analysis is to obtain 
a parsimonious description of observed data. Harmon (4) sees 
it as a technique to resolve a set of variables into a small 
number of elements, called factors. Resolution is accom- 
plished by the analysis of the correlations between the var- 
iables. Factor analysis, then, is essentially a linear re- 
@reessi1on of each of the variables on the factors. It yields 
factors which provide an adequate fit to the data, while 
maintaining all the essential information of the original set 


O£ Variables. 


Be. f£HE FACTOR ANALYSIS MODEL 


It is the object of factor analysis to represent a var- 
iable WS in terms of several underlying factors, or hypo- 
thetical constructs. Several types of factors may be dis- 
tinguished: 

1. Common Factors 
an )~ General. factor: present in all variables: 
b. Group factor: present in more than one, but not 
all, variables. 
2. Unique Factors: present in only a single variable. 


Common factors account for the intercorrelations among the 
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variables, while each unique factor represents that portion 
of a variable not attributable to its correlations with 
other variables of the set. 

The simplest mathematical model for describing one var- 
lable in terms of several others is a linear one, and that 
is the form of representation used in factor analysis models. 
Using the notation Fy, For For Tae ae for m common factors, 


the complete linear expression for any variable Ve may be 


WELecen In the form 


(3-1) Vie =a pepo as F pedo 


mMrere, 2 = 1, 2, «95 , n° and a is the coefficient of the 


13 
= has factor o© the gee variable. There are, of course, n 
equations of this form--one for each of the n variables. 
Some models also include a term a.U; which denotes the 
unique aspect of any variable--i.e., that portion of its var- 
iance which is not attributable to any common factor. Since 
factor analysis in general, and this paper in particular, is 


concerned primarily with the common factors, the unique term 


weld not be “ineluded “inthe medel “wsed herein. 


C. FACTOR LOADING AND COMMUNALITY 


The coefficients ae in equation (3-1), also called 
factor loadings, can be determined through an analysis of 


the correlations among the n variables. All m factors are 
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required to reproduce the correlation among the original n 
variables, and each factor, through its loading, is selected 
to make maximum contribution to the sum of the variances of 
the original variables. The first such factor selected makes 
the greatest single contribution; the second makes a maximum 
contribution to the remaining variance, and so on until a 
Satisfactory portion (usually less than 100%) of the total 
Original variance has been accounted for. Thus, depending 
on the amount of variance which will give a satisfactory and 
acceptable solution, only a small number (less than n) of 
factors will be needed to reproduce the original data. 

For any particular varvable, the amount of L1ts total 
variance accounted for by the common factors is called its 
communality. Quantitatively, the communality of a variable 
is given by the sum of the squares of the common-factor 


Geert rerents, Viz; 
(3-2) hi =a. 


where he is the communality of the ee variable Me and 


the are its’ Factor cocrficients. 


Aas 
1) 
The residual variance (one minus the communality) is 
the extent to which the variable is unique. It should be 
noted that although the communality can be increased by 


Simply increasing the number of: common factors extracted 


from the set of variables, this is not, in general, desirable. 
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Parsimonious description of the data requires that the num- 
ber of factors be kept to a minimum. 

Factor analysis techniques require communality est- 
imates as inputs. Successive iteration then leads to the 
final correct communality values. Making the original est- 
imate, however, can sometimes pose a difficult problem. 
There are three principal and commonly used estimating tech- 
niques. They are: | 

1. Set the original communality estimate equal to one 
for all variables--i.e., assume that all of the variance of 
the variables will be accounted for by the factors selected. 

2. Use the squared multiple correlations as the commu- 
nality estimates. 

3. Use the maximum row values of the correlation matrix 
as the communality estimate. 

These three techniques are discussed in detail by Harmon 
(4) and others and each has considerable merit in a variety 
of circumstances. The first technique listed above was used 
ZEOmethis* study, not; because of any” intrinsic superiority, 
but simply because of the author's subjective judgment. 

Having determined the communalities, it is then possible 
Egmeatculate the factor coefficients, or loadings. “The most 
frequently used technique (principal-component) begins by 
choosing a set of factors in decreasing order of their con- 
tribution to the total communality. The analysis is begun 
by “extracting:a factor F whose contribution to the commu- 


ui 


nalities of the variables is as great as possible. Then the 
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first-factor residual correlations are obtained. A second 
factor FP. with a maximum contribution to the residual 
communality is next found. This process is continued until 
the total communality has been analyzed. 

The first-factor coefficients a are selected to max- 
meze the sum of the contributions of that factor to the total 


communality. For the first factor (Fi), this sum is given by 
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The coefficients aay in equation (3-3) must be chosen so 


as to maximize C under the constraint (for m factors) 


it 
rm 
(3-4) ats » aS gs ig a i 2S Sere pide) 
p=] 
Were Fr... =r. and r.. is the communality of variable 
ik ki aie 
V5 (els, Oye ee nee the constraint condition (3-4) says 


that the reproduced correlations are to be replaced by the 
observed correlations, implying the assumption of no unique 
wartance (1.6., zero residual error) .— Recall that it was 
earlier stated ohee the unique factor would not be included 
in this model. 

Maximizacton Of: thas function (S-3) of n variables, 
constrained by Jn(n+l) conditions (3-4), is greatly facili- 


tated by the method of Lagrange multipliers, which may be 
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applied as follows: define the Lagrangian function (L) such 


that 


n n m 
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where the Hi, ( = Uys) are the Lagrange multipliers. Then 
set the partial derivative of L with respect to any one of 


the n variables (asy With 4 = 1, 2, 2°* , nm) equal “to zero: 


n 
(3-6) dL ae y = 
saree etic Y Mxter =e 


Similarly, set the partial derivative of L with respect to 


any of the other coefficients Pas for pi 7 1) “equal to zero: 


(3-7) ot, ee 


The two sets of equations, (3-6) and (3-7), may be combined 


as follows: 


(3-8) ce eae oe eae ie = 0 


were p = 1, 2, °** , m and the Kronecker Delta, “ip = 1 


of p= 1 and Sip = 0 if pl. Multiplying equation 


(3-8) by avy and summing with respect to i leads to: 


nN 
2 ze 
(5?) eae » ah 3 i rence 7 “e- 


Since, accordang to equation (3=6¢), 


Sein # Pane? it 


nN 
eS 


1 


then, by letting 


jal 
‘ 2 
Map aa 
ql 


where i is used for convenience only at this point but will 


be defined more rigorously later, equation (3-9) becomes 


n 
(3-10) §ip41 = ) Ferg = 0i5 
k=1 
Multiplying by op and summing with respect to p, equation 
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(3-10) becomes 


to-i1) 


Applying the constraining conditions 


the result is 


(3-12) 


which is a system of n equations. 


and dropping the subscript of 


ry 


tem of n equations may be written 


(Sad Ley 


sa oa 


+ 


(3=4) to equation (S=il), 
0 (Ge ces vs Dap eeuen ee ay) 
Recalling that. ©£.7= ne 
age a 
for convenience, this sys- 
as follows: 
MMe Wy By Hey SE 
allie 2a nd 
$- eco + eo = 0 
n nu 


The existence of a nontrivial solution to this system of 


equations requires that the determinant of the coefficients 


vanish, 


(3=14) 


as follows: 
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Expansion of this determinant results in an nee order 


polynomial in iA, known as the characteristic equation (of 
the system). The polynomial has a family of solutions, all 
of which are proportional to one particular solution, with 


the factor of proportionality given by 


n 
eo 2 
Ay = ) ah 
1 


Recall, however, from equation (3-3), that this is precisely 
the quantity to be maximized. It follows, therefore, that 


the maximizing solution to Cy is the largest root of the 


Ghatacteristic equation. “To find the coefficients of the 
frest Lactor (FL) which will account for the maximum amount 


of communality, the value of Ay is now substituted into the 


set of equations (3-13) and any solution Qs 39 Googe “29 Wn Gea 


mssObtained. To satisfy the conditions of equation (3-3), 
these values are divided by the square root of the sum of 


their squares and multiplied by Vay - the resulting quan— 


trepes are the desired coefficients of Fy in the facter 


pateern (3-1): 


a.,V- 
(3-15) aah = 2 
aa 
go. Se ae BA Cente 
ig 24 atl 
Meere 2 = 1, 2, 28 %.5 Ne In the literature of mathematics, 


the roots (A's) of the characteristic equation are called 


eigenvalues, while the solution to the set of equations (3-14) 
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corresponding to each eigenvalue leads to a vector (a set of 
a's) which is called an eigenvector. 

The problem now remains to find the coefficients of the 
remaining factors, accounting for a maximum amount of the 
residual communality. The residual correlation after the 


first factor has been extracted is given by 


(S=16) oa = an 


= 2 2. 2 
to—17 ) is ajo + az, + an 
Sapjece to- the constraint condition of (3-16). --Lteration*of 


the method of Lagrange multipliers yields A the second 


Du 
largest eigenvalue, as the maximizing value of Co: The 
second-factor coefficients are then determined as above. 


Successive iteration of this procedure will eventually pro- 


duce the complete set of factor coefficients, or loadings. 


Dew FACTOR ROTATION 


Once a set of factor loadings has been calculated, the 
next step in the analysis is to interpret the factors in a 
way that will give a meaningful summary of the observed data. 
Since the factor loadings are produced in an arbitrary frame 


of reference, the problem is to choose a reference frame for 
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the factor loading points which will give the most meaning- 
ful and/or most useful interpretation. To this end, the arbi- 
trary frame of reference may be rotated to one more suited to 
interpretation. There are numerous rotational techniques and 
criteria to select from. Thurstone (10), for example, has 
specified his criteria for simple structure which ideally 
would result in a relatively unique configuration of factor 
loadings and a relatively standard location for the reference 
frame. As pointed out by Morrison (8), however, the problem 
with these criteria is that they rarely exist when using real, 
data. For simplicity, rotational techniques can be grouped 
into two broad classes: orthogonal and oblique. Although 
orthogonal rotation is not suitable for all data, it has at 
least one distinct advantage. Since the resulting factors 

are orthogonal, they are uncorrelated (independent), which 
greatly facilitates interpretation. It should also be pointed 
out that the varimax orthogonal rotation technique was devel- 
oped by Kaiser (6) in 1958 to allow actual data to meet 
Thurstone's simple structure criteria as closely as possible. 


Taiseas the rotattonal technique which was used in this study. 


E. FACTOR SCORES 


From a purely theoretical point of view, the common 
factors have a more fundamental importance than the observed 
variables themselves and it is therefore necessary to relate 
the observations to the common factors. This is done by 


means of factor scores, which are a means of. expressing 
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quantitatively the information contained in a factor for a 
specific case or individual. Through the factor scores, the 
difference between two cases can be expressed in terms of the 
reproduced correlations of the original data. 

The computation of factor scores is based on the factor 
loadings previously determined. When using ones on the main 
diagonal of the correlation matrix, as in this study, the 
principal-factor solution may be expressed in matrix notation 


as follows: 


(313) Vo b= Ar 

where 
Vera= en. x 4.colunn, vector of. variables, 
AY = o.oo n Matrix of factor loadings, and 
tiaeep De OG 1 CObumm VECEOr Of) factorescores. 


The factor scores are then given by: 


(3-19) Poo A Vic 


F. FACTOR INTERPRETATION 


After the factor loadings and factor scores have been 
determined, there remains only the task of interpretation. 
A complete solution requires an identification of the nature 
ena content Of the hypothetical factors. Fruchter (3) in- 
dicates that this is commonly done by inferring what the var- 
iables with high loadings on a factor have in common that is 


present to a lesser degree in variables with moderate or low 
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loadings and absent from variables with zero (or near zero) 
loadings. He further defines an arbitrary classification 
scheme for factor loadings, as follows: 

i Lnsigniticant: Eactor loading below 0.2 

Zw WOW Lacton loading Of 0.2 EO 023 

5. Moderate: factor loading of 0.3 to 0.5 

feoagis) “factor Loading of 0.5 to 0.7 

5. Very high: factor loading above 0.7. 
Although Fruchter's classification scheme is admittedly arbi- 
trary, this phase of the analysis is necessarily less objec- 
tive and more subject to the desires and experience of the 
analyst than that which preceded. Even so, there is quan- 
Phcative JUStIT Cation for at least a portion of his classi-=- 
fication scheme. Recall that in linear regression, the 
Square of the correlation coefficient indicates the propor- 
tion of the total variance explained by the regression. Thus, 
a factor loading of 0.7, which separates the "high" and "very 
high" classifications, corresponds to a level. of correlation 
between the variable and factor in which nearly one half of 
the observed variance has been accounted for. 

A factor loading of 0.7 will therefore be adopted in 
Eeve study as being indicative of a "Significant" correlation 
between variable and factor. From there, an attempt will be 
made to assign convenient, understandable, and unambiguous 
names to the factors, based on an observation of those var- 


ijables with significant loadings. 
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IV. THE DATA 


The data for this study consisted of the fitness report 
summaries from 450 randomly selected Master Brief Sheets 
(form NAVMC HQ 466) for Marine Corps Officers in the grades 
Second Lieutenant through Colonel. The data was furnished by 
Headquarters, U. S. Marine Corps (Code MMPA) upon my official 
written request. Each Master Brief Sheet represents a com- 
plete fitness report record for a particular individual since 
mid-1972, when the Performance Evaluation System was automated. 
It contains all of the evaluations for the 22 dimensions pre- 
viously discussed. The personal information from Section A 
of the fitness report (see Appendix A) had been deleted from 
Gach Brief Sheet to insure the confidentiality of each indi- 
vidual's record. 

Of the original 450 Master Brief Sheets, 46 were found 
EOmcOntain ansufficient information to be useful in this 
study. Additionally, four of the 22 dimensions were dominated 
by "Not Observed" marks and were therefore eliminated from 
analysis. The eliminated dimensions, with percentage of "Not 
Observed" marks, were as follows: 

i. . Additional Duties - 89% 
2. Tactical Handling - 87% 
3. Endurance - 623. 


4. Presence of Mind - 93% 
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Since each Brief Sheet represents a separate observation of 
the variables (dimensions of performance), the data for the 
analysis consisted of 404 observations of 18 variables. 

Since the factor analysis technique is essentially 
mathematical in nature, it was necessary to convert the sub- 
jective non-numeric scale (excellent, above average, etc.) 
used by the reporting officers to a numeric scale suitable 
for the analytic technique. To do this it was first neces- 
sary to make an assumption about the distribution of the 
attributes which the fitness report is designed to measure. 
The Normal, or Gaussian, Distribution was assumed for this 
study, as is common in such cases. The argument for use of 
the Normal Distribution is strengthened by the fact that 
arithmetic means of variable markings were eventually used 
in the analysis. By the Central Limit Theorem, these means 
tend to be normally distributed, regardless of the actual 
underlying distribution (9). 

In a random sample of 100 fitness reports (from the 404 
Master Brief Sheets), the frequency, relative frequency, 
cumulative relative frequency, and standard normal deviate 
(z-value) for each mark, or scale vetiue (excellent, etc.) 
were determined. The results are shown in Table I. 

To calculate the mean, ordenpeeted value, of each of 
these marks (denoted by xX), let £(X) represent the dis- 
tribution function of the marks within the interval [2,25], 
where Zz and Zz are the minimum and maximum standard 


Bs Z 


normal deviates, respectively, of the mark. The expected 
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value is then given by: 


(4-1) X = 


Since the normal distribution has been assumed, f(X) is 


given by: 


2 
(4-2) if (Xe) = ans en a /2 (=aR< x << ‘@)); 


After substitution and integration, the desired scale values 


are given by: 


=f: e - e 
(4-3) X eee 


F(z.) - F(z,) 


where the numerator can be determined by direct substitution 
of the z-values and the denominator can be determined from 
any table of areas under the normal curve. 

As an illustrative example, let oe denote the value 


of an unsatisfactory mark. Then 


4 mn gs is lo)" Peg, Se Pay 


e - e 
V 27 


<I 
II 


un 
Fees 22 ee es) 


which, after substitution and reduction becomes 


(03989) (00056. —) 0) 
(020006 = 10) 


st 
lI 


un 


= 0 WASLIE 


Samaltarly, Me the value of a Below Average mark is given 
by: 


= pes (2.91)- 2 Sse o ONS 
Se a 


Vian 


<<! 
I 


ba Fie? OL) = Poa. 2p 


_ _~ (0.3989) (0.0145 - 0.0056) 
(0.0018 - 0.0006) 


Ai OZ 


I 


The results of these calculations were then subjected 
to a linear transformation to eliminate negative signs and 


decimal points. The transformation was of the form 
(4-4) P= 1000 00 x + 4.) 


where X is the scale value obtained from equation (4-3) and 
T is the more convenient transformed value. The results of 
these calculations and transformations are shown in Table II. 
The transformed values (T) were then substituted for 
their corresponding markings on each of the fitness reports 
and a statistical average for each of the 18 variables was 
obtained for each of the 404 individuals comprising the data 


base. The average values for each of the individuals, rather 


34 


> 0,0) 


0b.6) (MAGE bP eS! 


Table II. The Numeric Marking Scale 


ORIGINAL TRANSFORMED 
MARKS VALUE VALUE 

(X) | (T) 
Unsatisfactory - 3.7264 0273 
Below Average = 2). 9552 1045 
Average Se SNS 1344 
Above Average = LE SENS S) 2142 
Excellent = OF, 516 7.6 3412 
Outstanding 0.8387 4839 
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than the value of each mark on each of the available fitness 
reports, was used in the factor analysis to minimize the 
effect of "random error" caused by improper marking and rater 
bias. The result is the 404 by 18 matrix of markings con- 
tained in Appendix B. 

In addition to quantifying the individual markings, it 
was necessary to assign numbers to the variables to be 
analyzed, a somewhat more simple task. The numbering scheme 


ms) shown in Table III. 
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Table III. Variables to be Analyzed 


VARIABLE BEHAVIORAL 
NUMBER DIMENSION 

Jt Regular Duties 

2 Administrative Duties 
3 Handling Officers 

4 Handling Enlisted 

5 Training Personnel 

6 Personal Appearance 

| Military Presence 

8 ABEEHEL On to (uty 

9 Cooperation 

10 Initiative 
igi Judgment 

12 Foree 

13 Leadership 

14 Loyalty 
25 Personal Relations 

16 Economy in Management 
Aa | Growth Potential 

18 General Value to the Service 
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V. THE ANALYSIS 


Analysis of the data from the 404 observations of the 
18 variables was accomplished in two major steps. The first 
step utilized the complete data set, treating the sample 
population as an integral whole. In the second step, the 
data was separated into subsets, one subset for each rank 
(Second Lieutenant through Colonel) and one subset each for 
Company Grade Officers (Second Lieutenant, First Lieutenant, 
and Captain) and Field Grade Officers (Major, Lieutenant 
Colonel, and Colonel). The second step constituted an effort 
to determine whether or not significant observable differ- 
ences in factor structure exist between the various subgroups. 
In both steps, the data was analyzed using the Biomedical 
Factor Analysis program BMDO8M. The type of rotation and the 
number of factors extracted were varied in an attempt to 
account for the variance of a maximum number of variables. 
After a number of trial runs of the program, it was deter- 
mined that varimax orthogonal rotation for three factors pro- 
duced? very high’ factor loadings (greater than 0.7) on 12 of 
the 18 variables and accounted for 73.5% of their total var- 
lance. The next best combination of number of factors and 
rotation technique produced very high factor loadings on only 
tO variables; *withoutYan inerease in the proportion of total 


Variance accounted for. The three-factor varimax orthogonal 
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rotation procedure was therefore selected for use in the 


remainder of the analysis. 


A. ANALYSIS OF THE COMPLETE DATA SET 


Since factor analysis is essentially an analysis of the 
correlations between variables, a logical starting point is 
an examination of the correlation matrix, reproduced in Table 
Iv. This table shows the correlations between all possible 
pairs of variables. It shows a wide range of correlations, 
feom.0 31. to 0.84, and Syaaesede that there ac, an face; a 
high correlation between some of the variables. It does 
little, however, to illuminate a pattern which might reveal 
the underlying factors. The most essential and useful infor- 
mation is contained in the matrix of factor loadings, shown 
in Table V. 

Using the criterion, previously established, of very 
high factor loadings being significant, Table V shows that 
the following variables have significant loadings on the 
fest, factor: 

1. Regular Duties (variable 1) 

2.) lrarning,Personnel..(variable.5) 

3. initiative Cae tepie 10) 

4, Judgment (variable 11) 

BS. Force, (variabie. 12) 

6. Leadership (variable 13) 

7. Economy in Management (variable 16) 


This means that these seven variables are all closely related | 
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Table: Vi. 
VARIABLE 1 
i 0.7435 
2 0.6749 
3 0.5836 
4 0.5975 
5 O'..7267 
6 Oi. 319 
7 0.4413 
8 0.6662 
g) 0.3395 
10 Oc 7970 
ME On 720 
12 0.8046 
a3 O.. 71916 
14 0.2664 
LS Oz 99/2 
16 Ou209 
1) 0.5344 
18 0.6878 


4] 


FACTOR 


2 
0.2861 
0.1574 
O02 3968 
053330 
02429 
0.9116 
0.7385 
0.2062 
Om226)7. 
0:..2003 
O02 697. 
0.2404 
0.4504 
0.1244 
OS 26 
0). 2439 
0.6094 


0.4754 


Factor Loading Matrix 


3 

0.3664 
0.4105 
0.3860 
0.3543 
0.1574 
0.1487 
0.3037 
0.5195 
0.8000 
0.3170 
0.4168 
0.1459 
0.3269 
0.7469 
0.7425 
0.8571 
0.2694 


0.4018 


to a Single underlying factor and could be more efficiently 
represented by a single dimension--i.e., by a single question 
on the fitness report. Assigning an acceptable name to the 
factor requires both insight and judgment. An examination of 
the component variables reveals that they are principally 
task or goal oriented. They all measure some aspect of how 
an individual performs on the job. Since the sample popula- 
Exon Consists entirely of officers, it can be assumed that a 
typical job for a member of the sample is more than routinely 
mechanical. It undoubtedly requires leadership capability, 
coupled with force, initiative, and judgment. Economy in 
Management can be regarded as a measure of effectiveness of 
job performance and since nearly all Marine Officers have 
subordinates in their charge, the military concept of leader- 
Siep aMplles a training Lunction in nearly ali jobs. ‘Thus, 
all the variables with very high loadings on the first factor 
can be regarded as elements of task orientation or accom- 
plishment. 

AAdLeLOnal LASHGHE Into the nature ‘Of “the first factor 
can be gained from an examination of those variables which, 
although not having "very high" factor loadings, nevertheless 
had higher loadings on this factor ett on either of the 
other two. They are: 

1. Administrative Duties (variable 2) 
=. Uandiing Officers {variable 3) 
3. Handling Enlisted (variable 4) 
4. Attention to Duty (variable 8) 


5. General Value to the Service (variable 18) 
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Given the assumption that every Marine Officer inter- 
acts with both officer and enlisted subordinates in the per- 
formance of his duties, these variables are also task or goal 
oriented, with the possible exception of variable 18. De- 
ferring discussion of variable 18 for the moment, it seems 
safe to assign to the first factor a name such as "Task 
Orientation and Effectiveness". 

Turning now to the second factor, the variables with 
very high factor loadings are: 

1. Personal Appearance (variable 6) 

2. Military Presence (variable 7). 
These variables relate to how an individual appears and how 
he behaves, both of which are external manifestations of an 
internal quality which may be called pride or self-image. 
ies antecesting co, mote chat the hbighest factor loadings 
of all the cases occurred here, for Personal Appearance on 
factor two. Apparently, then, the external manifestation is 
as important as the underlying self-image. In order to in- 
clude both aspects, and to eliminate any confusion with cur- 
rently used names, the second factor will be called "Self- 
image and Bearing". 

The third and final factor had three variables with very 
high loadings. They are: 

i. Cooperation 1(variiabhe 9) 
25, shoyalty (varaable.14) 
3. Personal Relations (variable 15) 


Just as the first factor was clearly task-oriented, the 
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third is clearly people-oriented. It measures interpersonal 
behavior, or interaction. In one sense it also measures team 
spirit, since loyalty is presumably on a professional rather 
than personal level and applies to either the organization 

or its goals. The cooperation and personal relations, then, 
are with other members of the team. These variables measure 
more than just "Spirit", however. They also include a measure 
of how effectively the team spirit is established and main- 
tained. The third factor was therefore called "Team Orien- 
tation and Effectiveness". 

The three factors measured by a Marine Corps fitness 
Heport, then, relate principally to the task, the’ self, and 
the team. The three factors, using the names assigned above, 
are: 

1. Task Orientation and Effectiveness 

2. Self-image and Bearing 

3. Team Orientation and Effectiveness 
Two of these three factors correspond very closely to the 
results of a factor analysis conducted by Fleishman, Harris, 
and Burtt at Ohio State University (2). Their research was 
an attempt to isolate and define certain basic factors relat- 
ing to leadership and supervision in industry. They developed 
and administered a leadership description questionnaire which 
was then factor-analyzed. Their factor analysis produced two 
eommon factors, which they called "Initiating Structure" and 
"Interpersonal Effectiveness". The performance variables 


whch factored into ‘components of "Initiating Structure" 
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included those relating to patterns of task accomplishment. 
Explicit im thas factor were the behavioral dimensions of 
leadership and aggressiveness (force). Their study did not 
identify a factor comparable to "Self-image and Bearing", 
however. Such factors would seem to be limited to organiza- 
tions for which external image or appearance is important--as 
in the military services or certain large corporations, but 
not in industry (the environment for the enae State study). 

As stated earlier, the three common factors of this 
Study collectively accounted for 73.52%ef‘the total variance 
of all the variables. The equivalent information for any 
specific variable is contained in its communality, which is 
the proportion of its variance accounted for by the common 
factors. The communality of each of the variables is shown 
wo table VI. 

At this point it is possible to speculate about the 
Significance of variablé 18, General Value to the Service. 
If this variable actually measures what its terms and defi- 
nition indicate it should measure, it could indicate the 
relative importance of the three factors to the Marine Corps. 
For example, its highest loading ae Onjvihe first factor. 
This could, and probably does, indicate that Task Orientation 
and Effectiveness is the most important single dimension of 
Marine Corps performance, followed, though not too closely, 
byeecne ‘Second and thard factors in that order. This is not 
a particularly surprising result, since the military community 


commonly stresses the primary importance of the mission (task). 
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Table VI. Communalities 


VARIABLE COMMUNALITY 
i. 01.7689 
2 0.6489 
3 0.6089 
4 0.5934 
5 0.6229 
6 0.8706 
ii 0.8324 
8 027562 
9 0.8067 

10 OS 7757 
cau 06g 747 
IL 0.7264 
13. 0.8274 
14 4 0.6442 
LS 0.7385 
16 0.6614 
cig OC 7295 
18 0.8605 


As a final step in the analysis it was necessary to 
compare the relative scores of the 404 individuals on the 
three factors. This is the information that would be con- 
tained in a fitness report if the three factors, rather than 
the 18 variables, were used. The table of factor scores in 
Appendix C, then, represents the fitness report data for the 
404 individuals in reduced form. A comparison of Appendices 
B and C reveals that those individuals with low scores on 
the first factor received low markings on one or more of the 
Variables of which that factor is composed. Similarly, high . 
factor scores equate to high markings. 

As an illustrative example, individual (case) number 367 
tac a Lactor Score of =-5.05024 om the second factor. ~Appen- 
dix B reveals that this individual had markings of 1382 and 
1776 on the Personal Appearance and Military Presence var- 
iables, respectively. On the actual fitness reports for this 
individual, these numbers correspond to the following markings 
(for Six reports) : 

1. Personal Appearance: two Above Average, two Average, 
one Below Average and one Unsatisfactory. 

2. Military Presence: four Above Average and two Below 
Average. 

This is admittedly an extreme example, but it illustrates 
very clearly the correspondence between factor scores and 
actual markings. A thorough examination of Appendices B and 
C reveals that the correspondence between factor scores and 


fitness report markings holds throughout the set of data and 
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indicates that the three factors do, indeed, contain most of 


the essential information of the original 18 variables. 


B. ANALYSIS OF SUBSETS OF THE DATA 


During this phase of the analysis, the original data 
was separated into the following eight subsets: one for each 
of the six ranks, one for Company Grade jets. and one for 
Field Grade Officers. The subsets were then analyzed by the 
Same procedures that were used for the complete set. Each 
subset factored into three factors, as before. The factor 
loadings, communalities, and factor scores changed, but the 
composition of the factors remained relatively constant 
throughout. In no case did the proportion of total variance 
accounted for by the three factors fall below 70%. In short, 
Penexe seemed to be no Significant difference in factor struc- 
ture between any of the groups (including the complete data 
set) studied. In view of this finding, it seemed neither 
necessary nor worthwhile to reproduce the tables for each of 
the subsets of data. 

One Significant difference between the groups was, how- 
ever, revealed during this phase of the analysis. That dif- 
ference concerns the means of the markings on the various 
variables and is clearly visible in Table VII. The values 
gmethe tablevare the arithmetic means Of the values in Appen- 
dix B for the groups indicated. The last column of Table VII, 
titled "All", is the mean of all values of the specified var- 


jable. The last row, titled "Group", shows the means for 
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each of the indicated groups for all variables. Two facts 
stand out from this table: 

1. The mean marking for Second Lieutenant is higher 
than the corresponding marking for First Lieutenant in every 
case. 

2. The mean markings increase by rank from First Lieu- 
tenant in all but three cases, and the magnitude of the three 
reversals is very small. 

The trend indicated by paragraph (2) above is largely 
predictable, since it is assumed that only the "most quali- 
fied" individuals are promoted. The meaning of the reversal 
of this trend by First/Second Lieutenants is less clear, how- 
ever. One possible explanation is that Second Lieutenants, 
being largely young and inexperienced, are not judged by the 
Same standard as others--i.e., not as much is expected of 
them. 

One other point from this table is worthy of mention. 
The mean marking for variable 14, Loyalty, is consistently 
higher than all others for each group and for the sample as 
aauwmotle. This indicates either that all Marine Officers are 
very loyal or that reporting officers are ill-disposed to 
indicate otherwise. Considering the meaning which might be 
aeecached tokxa low marking on this variable (e.g., disloyalty), 
the latter is undoubtedly the case. 

Table VIII shows the standard deviations of the markings 
by variable and by sub-group. The last column gives the 


standard deviation of all marks for the given variable, while 
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the last row gives the standard deviation for each of the 
sub-groups and is calculated as follows (11): 


om 2 
iS) = M2 LB Su 


where, for each of the sub-groups, M is the mean of the 


So? 
variances of the variables and 5 is the variance of their 
means. 

The main point to be learned from Table VIII is that 
the total dispersion of marks decreases as rank increases, 
although there is no clear trend for any specific variable. 
This means that the markings for higher ranks are not only 
better (higher) in the average than for lower ranks (with 
the exception pointed out above), but also that they are more 
consistent. It would not be true, however, to say that the 
variance (square of the standard deviation) decreases to the 
point where there is an insignificant difference between 
the marks for the higher ranks. Since the marks on the 
fitness reports are used for promotion and retention pur- 
poses, variance is essential for the proper execution of 
such decisions. It appears from the data that even though 
the variance decreases, it remains sufficient, even in the 


higher ranks, to satisfy the needs of the system by providing 


peoasis for selection. 
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VI. CONCLUSION 


If personnel performance is important to an organiza- 
tion, it follows that performance evaluation is also important. 
It is not sufficient, however, simply to have a functioning 
system for the evaluation of performance. It is essential 
that the system be both effective and efficient. The system 
currently employed by the Marine Corps is apparently effective-- 
mothe sense that it fulfills its objectives to the satisfac- 
tion of its users. The question raised and examined in this 
study concerns not the effectiveness, but the efficiency of 
the system. Does the Marine Corps Fitness Report provide the 
necessary information in the most efficient way? Based on 
the analytic results presented earlier, it apparently does not. 

The 18 behavioral dimensions examined in this study 
undoubtedly contain information which is vital to the needs 
of the Marine Corps, but nearly three-quarters of this in- 
formation could be acquired by asking only three questions, 
rather than 18, about the Snaivicual being evaluated. As 
is frequently the case, there is a necessary trade-off be- 
tween comoleteness and efficiency. More information can be 
acquired by asking 18 questions than by asking three. And 
still more could be acquired from 20, 30, or 50 questions. 

But the larger reports are undoubtedly less efficient, since 
there is a limit to the amount of useful and relevant infor- 


mation that can be acquired. 
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The question to be answered, then, not by this paper 
but by the appropriate policy-makers, is: How much infor- 
mation is enough? If the amount of information contained 
gn the three factors proposed by this study is not sufficient, 
then additional factors should be introduced. The additional 
factors should correspond to those variables with low factor 
loadings on the three common factors, since they are the 
ones least represented by the common factors. 

The ultimate decision in this matter, however, depends 
on the needs and objectives of the system. The three factors 
hypothesized by this study appear adequate to satisfy those 
objectives, as they have been previously defined. The three 
factors can provide an evaluation of duties performed; they 
can provide a comprehensive portrayal of the professional 
qualifications, personal traits and characteristics, and 
potential of the individual; and they can provide a basis 
for determining duty assignments and promotional qualifications. 
And they can do all this faster and more easily than is 


possible in the existing system. 
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MATRIX OF MARKINGS 


APPENDIX B. 
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